Web Survey Bibliography
Relevance & Research Question: When asking respondents questions with long lists of response options allowing multiple answers response order effects may occur. In Web surveys, primacy effects are to be expected due to their self-administered nature since the respondents’ attention declines when reading long lists of response options. Instructions asking respondents to process all response options to the same extent have only limited effect. Web surveys offer the opportunity to make use of dynamic tools that have the potential to increase the respondents’ attention to such instructions. Among others, tooltips are an effective method to direct the respondents’ attention to specific elements of a question, in particular to instructions.
Methods & Data: The effect of tooltip instructions was tested in a randomized 2x4 between-subjects experiment embedded in a survey among university applicants (n=6.000). Factor 1 included the order in which a long list of 13 response options was presented (original vs. reversed order). Factor 2 referred to four different ways of presenting the instruction (control condition without instruction, static instruction displayed underneath the question, dynamic tooltip instruction appearing each time a respondent hovered the mouse pointer over a response option, and a combined condition integrating both a static and a dynamic tooltip instruction). For each condition we computed response order effects and compared their magnitude in order to assess the effectiveness of the instruction as compared to the control condition.
Results: Findings indicate that the average response order effect as well as the number of significant effects can be reduced using dynamic tooltip instructions. The reduction is about the same as compared to the effect achieved by a static instruction. When combining the two means of presenting the instruction (static and dynamic) the reduction in response order effects is even more pronounced.
Added Value: The study demonstrates the benefits of using dynamic feedback to respondents in Web surveys. Using tooltip technology works as a continuous stimulus throughout the question-answer process. However, dynamic instructions are not a substitute for static instructions, instead, findings suggest a particular effectiveness of using dynamic instructions jointly with conventional instructions.
GOR Homepage (abstract) / (presentation)
Web survey bibliography - Germany (361)
- Experiments in Obtaining Data Linkage Consent in Web Surveys ; 2013; Sakshaug, J. W., Kreuter, F.
- On the Impact of Response Patterns on Survey Estimates from Access Panels; 2013; Enderle, T., Muennich, R., Bruch, C.
- Evaluating the left‐right dimension: Category Selection Probing conducted in an online access...; 2013; Huefken , V.
- Methodological, legal and technical perspectives on the feasibility of web survey paradata in German...; 2013; Sattelberger, S.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Mobile devices a way to recruit hard-to-reach groups? Results from a pilot study comparing desk top...; 2013; Toepoel, V., Lugtig, P. J.
- The Relation of Survey Topic and Participation Behavior. Analyzing Unit Nonresponse using web-generated...; 2013; Zillmann, D., Schmitz, A., Blossfeld, H. P.
- Web questionnaires in official population surveys: Do's and don'ts First experiments and impacts...; 2013; Blanke, K.
- Möglichkeiten zur impliziten Messung von Emotionen am Beispiel webcambasierter Gesichtsausdruckserkennung...; 2013; Wachenfeld, A., Moentmann, A., Bernet, F.
- Mode effects in Labour Force Surveys - do they really matter?; 2013; Koerner, T.
- Identifying and Mitigating Satisficing in Web Surveys: Some Experimental Evidence; 2013; Rossmann, J.
- Does left still feel right? The optimal position of answer boxes in Web surveys - revisited; 2013; Lenzner, T., Kaczmirek, L.,Galesic, M.
- Latent legitimacy: joint effects of religious orientation on the association between values and acceptance...; 2013; Henseler, A. K., Siegers, P., Beckers, T.
- Identifying Satisficing Respondents in Web Surveys: A Comparison of Different Response Time-Based Approaches...; 2013; Rossmann, J.
- Comparison of quality of web survey and CATI data using unobtrusive response latencies; 2013; Mayerl, J.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- Using Eye Tracking Data to Understand Respondent's Processing of Rating Scales; 2013; Kunz, T., Fuchs, M.
- Advancing the field of questionnaire translation - identifying problems, discussing methods, pushing...; 2013; Behr, D., Dorer, B., Van Houten, G
- European Values Study - methodological and substantive applications; 2013; Luijkx, R., Jagodzinski, W.
- The Impact of Culture and Economy on Values and Attitudes; 2013; Duelmer, H., Voicu, M.
- Educational attainment in cross-national surveys: instrument design, data collection, harmonisation...; 2013; Schneider, S.
- Mode Effects in Mixed-Mode Surveys: Prevention, Diagnostics, and Adjustment 1; 2013; de Leeuw, E. D., Dillman, D. A., Schouten, B.
- Data Collection in Sociolinguistics: Methods and Applications; 2013; Mallinson, C., Childs, B., Van Herk, G.
- Use of Drag-and-Drop Rating Scales in Web Surveys and Its Effect on Survey Reports and Data Quality; 2013; Kunz, T.
- Online Panels: Recruitment Based on “Hot Topics” – What are the Consequences?; 2013; Andreasson, M., Martinsson, J.
- The Effectiveness of Mailed Invitations for Web Surveys; 2013; Bandilla, W., Couper, M. P., Kaczmirek, L.
- Pros and cons of virtual interviewers – vote in the discussion about surveytainment; 2013; Póltorak, M., Kowalski, J.
- The fish model: What factors affect participants while filling in an online questionnaire?; 2013; Mohamed, B., Lorenz, A., Pscheida, D.
- Interview Duration in Web Surveys: Integrating Different Levels of Explanation; 2013; Rossmann, J., Gummer, T.
- The monetary value of good questionnaire design; 2013; Tress, F.
- Technical and methodological meta-information on current practices in online research: A full population...; 2013; Burger, C., Stieger, S.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Measuring wages via a volunteer web survey – a cross-national analysis of item nonresponse; 2013; Steinmetz, S., Annmaria, B.
- Does one really know?: Avoiding noninformative answers in a reliable way.; 2013; de Leeuw, E. D., Boevee, A., Hox, J.
- Sensitive Topics in PC and Mobile Web Surveys; 2013; Mavletova, A. M., Couper, M. P.
- Mobile Research Performance: How Mobile Respondents Differ from PC Users Concerning Interview Quality...; 2013; Schmidt, S., Wenzel, O.
- Who responds to website visitor satisfaction surveys?; 2013; Andreadis, I.
- Measuring working conditions in a volunteer web survey; 2013; de Pedraza, P., Villacampa, A.
- Sampling online communities: using triplets as basis for a (semi-) automated hyperlink web crawler.; 2013; Veny, Y.
- Why are you leaving me?? - Personality predictors of answering drop out in an online-study; 2013; Thielsch, M., Nestler, S., Back, M.
- Propensity Score Weighting – Can Personality Adjust for Selectivity?; 2013; Glantz, A., Greszki, R.
- Research Design as an Influencing Factor for Reliability in Online Market Research; 2013; Wengrzik, J., Theuner, G.
- Ethics, privacy and data security in web-based course evaluation; 2013; Salaschek, M., Meese, C., Thielsch, M.
- Seducing the respondent – how to optimise invitations in on-site online research?; 2013; Póltorak, M., Kowalski, J.
- Influence of mobile devices in online surveys; 2013; Maxl, E., Baumgartner, T.
- E-questionnaire in cross-sectional household surveys; 2013; Karaganis, M.
- GESIS Online Panel Pilot: Results from a Probability-Based Online Access Panel; 2013; Kaczmirek, L., Bandilla, W., Schaurer, I., Struminskaya, B., Weyandt, K.
- Online Survey – Research with children on advertising impact; 2013; Funkenweh, V., Busch, J., Amthor, A. L., Boeer, A., Gaedke, J.
- HTML5 and mobile Web surveys: A Web experiment on new input types; 2013; Funke, F.